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Enduring  Value:  Required  Tectinology:  Open  Hyperdocument  Systems 

Knowledge  Creation  and 

Dissemination p.  2  IN  BRIEF:  Doug  Engelbart  is  the  seminal  visionary  in  the  field  of  computer- 
supported  collaborative  work.  For  over  40  years,  he  has  been  actively  involved 
in  the  design,  prototyping,  and  implementation  of  systems  to  support  collabora- 
tive knowledge  work.  This  two-part  issue  is  Engelbart's  call  to  action.  He  wants 
us  to  build  on  his  experience  to  speed  the  evolution  of  our  organizations' 
information  systems  into  true  collaborative  knowledge-refining  organisms. 

In  this  first  issue,  we  examine  the  technology  design  principles  that,  according  to 
Engelbart,  need  to  be  incorporated  in  the  evolution  of  open,  standards-based 
information  systems  in  order  to  support  collaborative  knowledge  work  optimally 
across  computer  systems  and  within  and  across  organizations. 
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This  month's  audiotape  contains  an  interview 
with  Doug  Engelbart — next  month  look  for  more 
of  my  discussions  with  Doug  on  videotape. 
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Equation 


Collaborative  Knowledge 
Work:  Key  to  Coping  with 
Increasing  Complexity  & 
Urgency 


In  1985,  Japanese  futurist  Taichi  Sakaiya  published  The  Knowledge-Value  Revolu- 
tion (Chika  Kakumei),  a  book  that  quickly  became  a  best-seller  in  his  country.  It  was 
translated  and  published  in  America  in  1991.  One  of  Sakaiya's  contentions  is  that  the 
knowledge  portion  of  all  goods  and  services  will  be  the  most  highly  valued  by  con- 
sumers. His  basic  premise  is  that  human  society,  by  nature,  gravitates  to  the  con- 
sumption of  those  resources  that  are  most  abundant.  And,  in  the  coming  decades, 
knowledge  and  time  will  be  our  most  abundant  resources.  Our  economic  systems, 
our  social  systems,  and  our  businesses  are  already  in  the  process  of  evolving  into 
their  new  "knowledge-value"  forms.  But  only  those  individuals  and  organizations 
that  can  capitalize  on  capturing,  leveraging,  and  incrementing  the  knowledge  portion 
of  their  goods  and  services  will  be  the  survivors  in  the  new  economic  order — a  worid 
in  which  mass-produced,  identical  goods  will  have  given  way  to  goods  custom- 
produced  by  entrepreneurial,  information  age,  knowledge  workers. 

Doug  Engelbart  came  to  similar  conclusions  about  the  value  of  knowledge  40  years 
ago  when  he  began  to  speculate  about  the  impact  of  two  converging  trends  he  wit- 
nessed in  the  world  around  him:  increasing  complexity  and  increasing  urgency.  He 
correctly  presumed  that  humans  would  not  be  able  to  deal  with  the  spiraling  effects 
of  these  two  inexorable  demands  on  business  and  society.  Since  his  academic  train- 
ing was  that  of  an  electronics  engineer,  he  turned  to  electronics  to  find  some  antidote 
for  the  ills  he  knew  were  about  to  beset  modem  society.  Engelbart  realized  that  the 
key  to  dealing  with  increasing  complexity  was  human  collaboration.  Many  human 
minds  with  different  perspectives,  different  specialties,  and  different  experience 
bases  working  together  and  sharing  their  knowledge,  perspectives,  and  experience 
would  be  able  to  master  complex  tasks  that  no  single  human  would  be  able  to 
master. 


The  Knowledge-Value  Revolution  by  Taichi  Sakaiya,  was 
published  by  Kodansha  International  in  1991.  (Distributor: 
Kodansha  America,  Inc.  NY)  ISBN  (U.S.):  0-87011-942-7. 


Douglas  C.  Englebart,  Director,  Bootstrap  Institute 
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An  Organization  Is 
Composed  of  Multiple 
Knowledge  Domains 


Understanding  the  Basic 
Knowledge  Process 


# 


How  Any  Organizational 

Unit  Processes 

Knowledge 


Engelbart  sees  every  organization  as  a  collection  of  interacting  knowledge  domains. 
He  has  focused  his  research  on  designing  support  structures  for  knowledge  collection 
and  refinement  within  and  across  these  knowledge  domains. 

According  to  Engelbart,  each  knowledge  domain  or  organizational  node  uses  the 
same  basic  process  to  assimilate,  analyze,  integrate,  digest,  and  re-use  the  knowledge 
products  it  creates.  Once  we  understand  that  process,  we  can  support  and  enhance  it 
with  computers,  communications,  and  software.  Here  is  how  Engelbart  depicts  this 
basic  knowledge  process: 


EVERY  VIABLE  ORGANIZATIONAL  UNIT  REQUIRES 
BASIC  KNOWLEDGE  PROCESSES 


Interacting         |  Scanning 
Ingesting 


Analyzing 

Digesting 

Integrating 

Developing 

Re-using 


The  basic  knowledge  processes  of  each  viable  organizational  unit.  The  organism 
scans  its  external  environment  for  new  information  and  ingests  that  information.  At 
the  same  time,  the  organizational  unit  is  interacting  with  the  rest  of  the  world  in 
conversations  and  dialogue.  The  members  of  the  unit  are  working  together  to  pro- 
duce an  evolving  knowledge  product  that  consists  of  the  output  of  their  work  and 
everything  it  took  to  produce  that  work. 
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An  Exploded  View  of  the      it  wc  lake  a  closer  look  at  the  on-going  basic  knowledge  process,  we  see  that, 
Knowledge  Collection  according  lo  Engelbart,  it  can  be  scgmenicd  into  three  distinct  types  of  information, 

and  Assimilation  Process     each  of  which  exists  in  the  context  of  the  continuous  and  dynamic  Concurrent  De- 
velopment, Integration,  and  Application  of  Knowledge  (CODIAK)  process. 


The  CODIAK  Process 


THE  CODIAK  PROCESS  -- 
COLLABORATIVE.  DYNAMIC,  CONTINUOUS 


Dialog 
Records 


Knowledge 
Product 


Memos 
Status  reports 
Meeting  nninutes 
Decision  trails 
Design  rationale 
Change  requests 
Docunfient  review 
Lessons  learned 
Bug  reports 
Field  spt  logs 
Design  reviews 


Articles,  books 
Reports,  papers 
Conf.  procedings 
Brochures 
Market  surveys 
Industry  trends 
Competition 
Suppliers  info 
Customer  info 
New  technologies 
New  techniques 


Proposals 

Plans 

Budgets 

Legal  contracts 

Milestones 

Time  lines 

Design  specs 

Product  descriptions 

Mfg  plans 

Test  plans  &  results 

Field  spt  manuals 


CODIAK:    concurrent  Development,  integration,  &  Application  of  Knowledge. 


Today's  Systems  Aren't 
Set  up  to  Capture 
Knowledge 


Needed:  A  Common 
Infrastructure  for 
Collecting  and 
Interrelating  All  Forms  of 
Knowledge 


Engelbart  asserts  that  the  CODIAK  process  is  the  way  humans  acquire  and  evolve 
their  knowledge  in  collaboration  with  others.  He  notes  that  we  haven't  set  up  our 
computerized  information  systems  to  deal  with  all  three  forms  of  these  knowledge- 
building  categories  of  information  in  any  integrated  way.  Therefore,  we  aren't  reap- 
ing most  of  the  benefits  that  could  be  derived  from  the  CODIAK  process  within  a 
single  organizational  unit,  not  to  mention  the  benefits  that  could  be  derived  by  de- 
signing architecture  to  support  it  across  organizational  units  and  across  organiza- 
tions. 

As  you  can  see  from  Engelbart 's  conception  of  the  CODIAK  process,  he  feels  that 
there  should  be  no  distinction  made  between  formal  and  informal  documents  and 
between  intemal  and  external  (to  the  system  or  organization)  information.  The  way 
that  any  organism  (individual,  department,  or  larger  entity)  builds  and  modifies  its 
view  of  the  world  depends  on  making  interrelationships  among  all  of  these  different 


The  Bootstrap  Institute 
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Email:  lnfo(g)Bootstrap. stanford.edu 


modes  and  forms  of  inforaiation.  It  is  also  essential  that  information  be  maintained, 
to  the  extent  practicable,  in  context. 


STAGES:  SUPPORTING  THE  CODIAK  PROCESS 
FOR  A  MUTUAL  KNOWLEDGE  DOMAIN 


i  nj]  "Throw-Away"  Mail, 


I -^if  D^^  D =□  r 


The  Role  of  the  Journal,  in  Engelbart's  ideal  world,  everything  that  people  want  to 
build  upon  and  refer  to — both  the  material  they  create  electronically  and  the  material 
they  make  reference  to  in  the  outside  world — should  be  "joumaled."  That  is,  it 
should  be  uniquely  labelled  by  the  system  and  preserved  so  that  people  can  continue 
to  make  use  of  it  and  reference  it.  Joumaling  also  enables  you  to  easily  keep  track  of 
multiple  versions  of  a  work  in  progress  or  of  multiple  iterations  of  a  budget.  Each 
one  is  joumaled,  the  journal  knows  which  one  supersedes  the  others,  and  usually 
only  the  new  or  changed  material  really  needs  to  be  kept. 


How  many  of  you  already  keep  an  electronic  log  or  journal  of  files  written  and  received, 
electronic  mail,  and  so  on?  Wouldn't  it  be  nice  if  your  system  automatically  filed  that 
information  for  you?  Wouldn't  it  be  nice  if  you  could  easily  add  references  to  external 
documents,  flyers,  brochures,  customer  correspondence,  etc?  Wouldn't  it  be  nice  if  others  in 
your  organization  could  have  access  to  that  information,  so  they  could  refer  to  it,  link  to  it, 
etc.?  What  would  you  do  with  your  private  documents?  Probably  encrypt  them  or  password 
protect  them  so  they  could  be  maintained  with  the  rest,  but  only  viewable  by  you.  What  about 
potentially  incriminating  documents?  Internal  discussions  of  a  sensitive  nature?  Would  you 
keep  them  joumaled,  or  shred  them  quickly? 
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Designing  Systems  to 
Support  the  Evolutionary 
Growth  of  Knowledge 


What  Should  You  Keep?  I  asked  Engclbart  about  the  need  to  maintain  and  journal 
"throw  away"  electronic  mail.  His  experience  showed  that  it  was  much  easier  lo 
consider  everything  in  the  system  useful  and  preserve  it  than  to  require  people  to  go 
through  the  mental  exercise  of  deciding  a  priori  what  to  preserve. 

How  the  Knowledge  Base  Organically  Prunes  Itself.  Obviously,  every  bit  of  infor- 
mation generated  on  a  system  is  not  going  to  prove  useful  or  relevant.  In  fact,  only  a 
relatively  small  portion  of  it  might  prove  really  useful.  Therefore,  according  to  En- 
gelbart's  design,  every  time  anybody  references  any  material,  whether  it  is  a  mail 
message,  a  graphic,  or  an  official  memo,  that  fact  is  noted  and  becomes  an  attribute 
of  the  referenced  item.  That  way,  the  material  that  is  never  referenced  by  anyone  au- 
tomatically becomes  a  candidate  for  routine  archiving.  A  record  is  maintained  of  its 
existence  and  its  archived  location  enabling  you  to  retrieve  it  in  case  the  information 
ever  becomes  important  in  retrospect.  So  you  can  see  that  Engelbart's  design  of  an 
evolving  information  infrastructure  or  knowledge  base  is  an  organically  self-limiting 
beast. 

Doug  Engelbart  is  adamant  about  the  fact  that,  according  to  his  experience,  it  is  not 
possible  to  really  take  advantage  of,  build  on,  and  evolve  an  organism's  knowledge 
base  unless  that  information  can  be  both  interrelated  and  structured. 

The  Importance  of  Structured  Documents.  Documents,  whether  they  are  memos, 
CAD/CAM  drawings,  or  database  views,  already  have  an  inherent  structure  that  is 
derived  from  the  conceptual  model  the  author  had  when  he  created  them.  The  struc- 
ture of  documents  is  not  arbitrary  or  force-fit,  but,  rather,  derives  from  the  natural 
organization  of  the  concepts  being  presented  (which,  of  course,  can  sometimes  be 
improved  upon  by  reorganizing,  or  restructuring,  the  document).  Engelbart  is  not  ad- 
vocating that  we  perform  artificial  acts  with  documents  by  superimposing  structure 
on  them.  Instead,  he  advocates  that  we  capture  the  inherent  structure  in  all  forms  of 
human  expression  in  order  to  make  them  easier  for  people  to  navigate  through,  view 
in  different  ways,  and  hyperlink  (interlink  one  point  in  one  document  with  a  point 
made  or  illustrated  in  one  or  more  documents). 

The  Importance  of  Views.  Those  of  you  who  have  worked  with  a  word  processor, 
spreadsheet,  or  database  that  understands  the  notion  of  collapsing  and  expanding 
views,  or  outlining,  have  probably  grown  to  appreciate  that  feature.  Engelbart  feels  it 
is  imperative  that,  in  a  truly  open  and  interoperable  world,  people  should  be  able  to 
have  total  and  very  flexible  control  over  how  they  want  to  view  information.  And, 
since  we  are  not  likely  to  all  choose  to  use  the  same  appUcations  to  create  our  infor- 


Please  pay  attention  to  this  discussion.  The  importance  of  using— 
not  losing — the  structure  in  our  documents,  CAD  drawings,  etc.  is 
finally  dawning  on  most  of  us  as  we  begin  to  organize  and  keep 
more  information  electronically.  Without  structure,  information  is 
not  really  actionable.  You  can't  find  what  you  need  quickly,  and 
when  you  do  find  it,  the  actions  you  can  take  are  limited,  once  all 
the  structure  (and  behavioural  knowledge)  has  been  removed. 


mation,  it  is  also  imperative  that  there  be  a  consistent  set  of  viewing  behaviors  and 
navigational  conventions  in  all  interoperable  applications. 


Two  Different  Views 

Enabled  by  Document 

Structure 


VIEWS 

<  c>                                                                    next  viGw-»<  n> 

; 

7   CONTROLLING  THE  VIEWS 

7a  A  user  ot  a  book,  or  of  most  on-line  text 

7b  MULTIPLE  WINDOWS 

7b1   For  whatever  total  screen  area  is 
7b2  (Note:  Cross-file  editing  can  be 
7b3  User-adjustable  parameters  are 

7c  WINDOW  VIEWS 

7c1   STRUCTURE  CUTOFF.  Show  only 

7c2  LEVEL  CLIPPING.  For  the 

7c3  STATEMENT  TRUNCATION.  For 

L__ 

VIEW:  All  levels:  Numbers  On:  1  line  per 
statement;  No  blank  lines. 

VIEWS 

<:ebt>                                                               next  vJew-*-<  zg> 

7  CONTROLLING  THE  VIEWS 
7a  A  user  of  a  book,  or  of  most  on-line  text 
7b  MULTIPLE  WINDOWS 
7c  WINDOW  VIEWS 
7d  USER-SPECIFIED  SEQUENCE 

i 

L 

VIEW:  2  levels;  Numbers  On;  1  line  per  statement; 
Blank  lines. 

Filtering  &  Navigating  with  Views,  in  Engelbart's  scheme  of  things,  views  aren't 
used  only  to  condense  and  expand  views  of  information.  You  can  also  create  special 
purpose  filters— for  instance,  everything  written  by  a  certain  person  on  a  certain 
topic.  In  fact,  in  Engelbart's  original  system,  end  users  could  give  instructions  to  a 
module  known  as  a  sequence  generator  to  create  special  puipose  hypertrails  through 
webs  of  information. 


The  Importance  of  the  need  for  flexible  Views  really  came  home  to  me  when  I  visited  Clorox 
recently  and  looked  at  the  documentation  they  use  for  their  manufacturing  process.  Different 
people  in  the  plant  need  very  different  views  of  information:  recipes,  safety  information, 
packaging  information,  shipping  information —  and  yet  it's  all  part  of  an  organically  changing 
whole. 
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The  Need  for  Granularity.  As  you've  probably  deduced  from  the  emphasis  on 
prcser\ing  siruciure,  inheritance,  and  hierarchy  in  documents,  and  the  desirabihiy  of 
using  that  structure  to  expand  or  collapse  infonmation  so  that  you  can  view  it,  filter 
it,  and  navigate  through  it  at  different  levels  of  detail,  it  is  also  imperative  to  be  able 
to  precisely  direct  a  reader's  attention  to  a  ver>'  specific  point  within  a  document.  We 
agree  with  Engelbart  that  it's  not  sufficient  to  insert  a  hyperlink  from  one  document, 
card,  or  note  file  to  another.  Instead,  you  really  need  to  be  able  to  link  ver>'  precisely 
to  a  specific  phrase,  word,  or  even  a  single  character  within  a  document  or  file. 

The  Need  for  Relative  Addressability,  it's  also  important  to  be  able  to  direct  a  per- 
son or  an  application  to  the  referenced  point.  Engelbart  explains  it  this  way:  "It's  like 
the  way  the  municipal  system  puts  house  numbers  on  houses.  You  can  use  it  if  you 
wish  10  tell  somebody  how  to  get  to  a  certain  house,  or  send  a  letter  to  it.  Or  you  can 
say,  'If  you  go  to  4ih  and  Main  and  go  west  on  4th  until  you  find  the  second  yellow 
house  on  the  left.'  That's  another  way,  relatively  speaking.  You  give  an  exact  ad- 
dress and  then  something  relative  to  it.  Or  you  can  say,  'Hey,  someplace  on  4th,  west 
of  Main,  you  can  find  where  Joe  lives.  Go  ask  for  Joe. '"Similarly,  if  you  didn't 
remember  the  exact  directions  to  give  someone  to  find  something  you  want  him  to 
see  in  the  electronic  world,  you  could  direct  him  to  a  particular  node  in  the  system 
and  then  tell  him  to  go  down  a  level,  jump  to  the  end,  and  take  the  second  link  he 
finds  there. 

The  Need  for  a  Common  Command  Language.  As  we  begin  to  interconnect  our  or- 
ganizations' information  systems  via  networks,  electronic  mail,  interoperating  appli- 
cations, and  shared  work  products,  it  will  become  more  and  more  essential  that  these 
information  systems,  applications,  and  the  information  itself  respond  consistently  to 
the  commands  we  use  to  interact  with  information  and  to  navigate  through  it.  Doug 
Engelbart  describes  the  future  this  way:  "Suppose  you  and  I  work  for  two  different 
companies,  using  two  different  computer  systems  and  many  different  applications. 
One  day,  you  send  me  an  electronic  mail  message  relating  to  some  work  that  we  are 
doing  together.  The  message  contains  a  link  to  information  in  a  file  that  you  want  me 
to  review.  The  file  is  located  on  your  system,  and  you  have  granted  me  read/write 
permission  to  this  file  for  the  duration  of  this  project.  There  is  only  one  hitch.  When 
I  click  on  the  link  and  am  transported  across  the  network  into  your  information  sys- 
tem and  the  file  is  opened  for  me  along  with  the  application  required  to  manipulate 
the  information,  how  do  I  know  what  to  do?  Do  the  buttons  in  your  application  do 
the  same  things  that  I'm  used  to?  How  do  I  know  how  to  navigate  through  the 
file/application?" 


No  one  else,  with  the  possible  exception  of  Dave  Liddle  of 
Metaphor/Patriot/IBM  has  argued  so  coherently  for  a  set  of  cross- 
system  behavioral,  navigational  and  command  standards  and 
expectations.  If  all  our  systems  act  differently,  not  only  on  the 
surface,  but  also  deep  down— if  there  is  no  underlying  unifying 
structure— we'll  never  achieve  the  level  of  interoperability  we  need 
'to  design  knowledge-based  organizations. 


What  Steps  Can  We  Take 
to  Evolve  an  Open 
Hyperdocument 
Standard? 


This  simple  example  (simple  because  only  two  people  and  two  systems  arc  involved) 
illustrates  the  point.  If  we  are  to  have  that  kind  of  interactivity  among  knowledge 
workers  and  across  applications  and  systems,  we  need  to  pay  more  attention  to 
agreeing  on  a  core  set  of  commands,  methods,  and  navigation  conventions,  that 
could  be  implementable  across  applications.  These  would  need  to  be  extensible,  of 
course,  so  that  special  purpose  commands  and  shortcuts  could  be  added.  One  of  the 
analogies  that  Engelbart  makes  to  describe  this  phenomenon  is  the  following;  If  you 
were  suddenly  transported  from  New  York  City  to  a  village  in  the  south  of  France, 
and  you  didn't  speak  French,  how  would  you  find  your  way  around?  As  human  be- 
ings, we  have  conventions  for  these  things  that  cross  cultural  boundaries — maps, 
street  signs,  directional  signals,  common  conventions  (such  as,  in  many  parts  of  the 
world,  sidewalks  and  streets)  that  people  have  developed  and  learned  over  time.  As 
we  work  to  define  standards  for  open,  interoperable  systems,  we  need  to  take  care 
that  we  also  agree  upon  and  evolve  standard  conventions  for  commands,  navigation, 
and  expected  behavior  of  certain  classes  of  objects. 

Needed:  User  Experience.  Engelbart  assumes  that  the  future  tool-base  underlying 
our  highly  improved  CODIAK  capability  will  be  a  multi-media,  hyperdocument 
system.  Engelbart  feels  that  the  only  way  to  seriously  work  towards  creating  a  viable 
specification  for  an  open  hyperdocument  architecture  is  to  get  real  users  in  real 
businesses  to  pool  their  experiences  as  they  work  toward  creating  improved 
CODIAK  capabiliues  within  their  own  organizations.  Some  people  will  begin  to 
build  improved  CODIAK  capabilities  using  their  exisfing  systems  and  running  into 
and  documendng  the  roadblocks  they  encounter.  But  for  much  greater  evolutionary 
efficiency,  a  number  of  organizations  may  choose  to  collaborate  on  the  development 
of  a  shared,  common,  prototype  hyperdocument  system  to  support  cooperatively 
planned  CODIAK-enhancement  pilots  in  each  organization — integrating  their 
collecfive  users'  experiences  toward  evolving  an  ever  more  generic  and  interoperable 
hyperdocument  system.  If  one  or  more  such  collective  initiatives  got  underway,  all 
poooling  resources  and  experiences,  they  would  be  able  to  distill  the  most  important 
specifications  and  requirements  and  begin  to  work  with  standards  groups  and 
consortia  to  make  these  requirements  part  of  the  open  systems  interoperabihty 
process. 

Start  with  Engelbart's  Paper  on  the  OHS.  I  recommend  that  you  start  by  requesting, 
from  the  Bootstrap  Insfitute,  a  copy  of  the  paper,  "Knowledge-Domain  Interoper- 
ability and  an  Open  Hyperdocument  System."  This  paper  goes  into  a  bit  more  detail 
in  delineating  the  specific  requirements  that  Englebart  foresees  we'll  need. 


If  you'd  like  more  information  about  Engelbart's  Boostrap  Initiative,  or,  if  you'd  like  to 
order  the  article  mentioned  above,  "Knowledge-Domain  Interoperability  and  an  Open 
Hyperdocument  System,"  call  (510)  713-3550. 
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